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BACKGROUND 


HDR Rendering As It Stands Today 


Many applications already use HDR for rendering 
Desire for linearity and preservation of relative brightness 
Render into FP16 (aka half-float, 16 bits per component buffer) 


“Tone-map” from FP16 to lower precision non-linear, e.g. RGBA8 sRGB drawable 


TrueColor/DirectColor Visual Classes are adequate for presenting RGBA8 sRGB 


BACKGROUND 


HDR Presentation Is Needed 


New displays support 10 or 12 bit HDR input, e.g. HDR10 (10-bit integer BT.2020 PQ) 
Linear HDR formats also needed for composition 
Future displays may also support FP16 input 


Do not “tone-map” to SDR 
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CURRENT 


STATUS 


DeepColor X Extension 

2nd draft on xorg-devel 

Adds new X visual class “DeepColor” 

Extra mechanisms for querying new metadata 


Protocol perspective, implementation to come 


DeepColor Extension 
Version X.X 
2017 -XX-XX 


Alex Goins 
agoins@nvidia.com 
NVIDIA Corporation 
1. Introduction 


The DeepColor Extension provides a new visual class, DeepColor, designed for 


THE CASE FOR A NEW VISUAL CLASS 


THE CASE FOR A NEW VISUAL CLASS 


Pixel Formats 


typedef struct { 


Visual *visual; FrueCeler 
VisuallbD visualid; 
int screen; DirectColor 


unsigned int depth; 
Int class; 
unsigned long red mask; 
unsigned long green mask; 
unsigned long blue mask; 
int colormap size; 
int Bite, per gb; 

} XVisualInfo; 


Maximum 32-bit 


Only relevant to integers 


7 NVIDIA. 


THE CASE FOR A NEW VISUAL CLASS 


Pixel Formats 


typedef struct { 


Visual “visual; 
VisualID visualid; 
int screeni 
unsigned int depth; 
int class; 


} XVisualInfo; 
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THE CASE FOR A NEW VISUAL CLASS 


Color Spaces and Encodings 


SRGB 


BT.2020 PQ 


DCI-P3 Linear 
ACES APO 


BT.2020 HLG 


BT.2020 Linear 


DCI-P3 Gamma 
ACES AP1 


scRGB Linear 
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THE CASE FOR A NEW VISUAL CLASS 


Design Goals 


CIE 1931 Chromaticity Diagram - Color gamut of UHDTV, P3 and HDTV 


Support high precision integer and half-float formats on (2000) 


HDTV ( Rec.709 ) 


Enumerate set of color spaces and encodings 
Flexible selection 
Support composite managers (“external compositors”) 


Support in-server compositing (“internal compositors”) 


Avoid breaking existing applications 
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EXTENDED VISUAL INFO 


EXTENDED VISUAL INFO 


DPCGetVisuallnfo 


struct XVisuallnfo is not adequate for describing many HDR pixel formats 
Addins additional fields to struct XVisuallnfo could complicate compatibility 
Follow formula of e.g. EVI and DBE X extensions 

Pixel format exposed through extended visual info requested by Visual ID 


Changing pixel format requires destroying and recreating drawable with new visual 
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EXTENDED VISUAL INFO 


Pixel Formats 


UINT_R16G16B16A16 


FP_R16G16B16A16 UINT_A2R10B10G10 
UINT_A2B10G10R10 
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WINDOW PROPERTIES 


WINDOW PROPERTIES 


Exposing Color Space and Encoding è 


Expose color space and encoding being rendered by application 


Expose capabilities of compositor 


Expose capabilities of display 
Support both external and internal compositors 


PropertyNotify feedback 
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WINDOW PROPERTIES 


Enumerated color spaces and encodings 


Constant definitions describing set of possible color spaces / encoding pairs 


Additional color spaces / encodings require revision of spec 


0.27,1.24 


scRGB Linear 
BT.2020 Linear, PQ, HLG 


DCI-P3 Linear, Gamma 


ACES APO (Linear), AP1 (Linear) 


BT.2020 


DCI-P3 
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WINDOW PROPERTIES 


Property of Root Window 


_DEEPCOLOR_PROPERTIES, WINDOW/32 


Global window properties must be associated with root window 

Problem: Listening to PropertyNotify events on root window results in spam 
Create child of root window named “DEEPCOLOR_PROPERTIES” 

Find child via root window property _DEEPCOLOR_PROPERTIES 
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WINDOW PROPERTIES 
Property of “DEEPCOLOR_PROPERTIES” 


_DEEPCOLOR_COMPOSITOR_COLORSPACES, colorspace, score, CARDINAL[][2]/32 


Set of color spaces and encodings supported by compositor 
Initialized by internal compositor, overridden by external compositor 
Selection prioritized by score 


Target surface should correspond to highest score to minimize conversion overhead 
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WINDOW PROPERTIES 
Property of “DEEPCOLOR_PROPERTIES” 


_DEEPCOLOR_DISPLAY_COLORSPACES, colorspace, score, CARDINAL[][2]/32 


Set of color spaces and encodings supported by server for display 

Initialized by server (X driver) 

Used to bootstrap external compositors 

Primary mode should correspond to highest score to minimize conversion overhead 


Set of color spaces and encodings cannot change, but score can change 


19 SINVIDIA. 


WINDOW PROPERTIES 


Property of HDR Window 


_DEEPCOLOR_COLORSPACE, CARDINAL/32 


Color space and encoding being used for rendering into window 
Selected based on scoring of compositor color spaces 
Application must listen for PropertyNotify events to determine if capabilities change 


Application may change to any supported option at any time 
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CONTROL FLOW 


Misc. Protocol 


Window Property Write 


CONTROL FLOW use tc 


Server Initialization 


Server 


Root Window 
_DEEPCOLOR_ PROPERTIES 


CreateWindow 


— ( DEEPCOLOR BT2020 LINEAR, 85) 
= _DEEPCOLOR_DISPLAY_COLORSPACES — — — 
= _DEEPCOLOR_COMPOSITOR_COLORSPACES 
4 
( DEEPCOLOR BT2020 LINEAR, 100), 
( DEEPCOLOR BT2020 PO, 85), 
( DEEPCOLOR SCRGB LINEAR, 75) 
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Misc. Protocol 


Window Property Write 


CONTROL FLOW use tc 


HDR Window Creation 


FP R16G16B16A16 


Root Window EM 
_DEEPCOLOR_PROPERTIES sl 


“DEEPCOLOR_PROPERTIES” 
_DEEPCOLOR_DISPLAY_COLORSPACES 
_DEEPCOLOR_COMPOSITOR_COLORSPACES 


DeepColor Window 
- _DEEPCOLOR_COLORSPACE 


_DEEPCOLOR BT2020 LINEAR 
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Misc. Protocol 


Window Property Write 


CONTROL FLOW us tc 


HDR-Aware External Compositor Override 


RedirectSubwindows 


PropertyNotify 


Compositor 


Root Window 
_DEEPCOLOR_PROPERTIES 


— 
A e e e e 


“DEEPCOLOR_PROPERTIES” 
_DEEPCOLOR_DISPLAY_COLORSPACES 
_DEEPCOLOR_COMPOSITOR_COLORSPACES 


w 
ee = ee eee ‘a 


Server 


PropertyNotify 


Application 
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Misc. Protocol 


Window Property Write 


CONTROL FLOW us tc 


HDR-Unaware External Compositor Override 


RedirectSubwindows 


Compositor 


Root Window 


DEEPCOLOR_PROPERTIES “DEEPCOLOR_PROPERTIES” 
_DEEPCOLOR_DISPLAY_COLORSPACES 
_DEEPCOLOR_COMPOSITOR_COLORSPACES 


DeepColor Window 
_DEEPCOLOR COLORSPACE <-------- "ER 


Server 


PropertyNotify 


Application 
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Misc. Protocol 


Window Property Write 


CONTROL FLOW us tc 


Transition Back to Internal Compositor 


UnredirectSubwindows 
(or connection dies) 


! Compositor 
Root Window 


_DEEPCOLOR_PROPERTIES “DEEPCOLOR_PROPERTIES” 
_DEEPCOLOR_DISPLAY_COLORSPACES 
_DEEPCOLOR_COMPOSITOR_COLORSPACES 


DeepColor Window 
_DEEPCOLOR COLORSPACE <-------- "ER 


Server 


PropertyNotify 


Application 
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ISSUES 


ISSUES 


HDR Unaware Clients 


DeepColor visuals could cause naîve clients to crash 

Suggestion for TrueColor-masquerading DeepColor visuals 

Downsample automatic redirection, XGetlmage(), core X11 / RENDER rendering 
Problem: Duplicate TrueColor visuals could cause unnecessary conversions 


Opt-in mechanism via core protocol minor version bump? 
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ISSUES 


DCI-P3 White Point and Gamma 


DCI-P3 doesn’t have a defined white point or gamma 

Relatively small set of possible white points could be enumerated 
Gamma could be anything, varies by display 

Additional gamma field in window property tuples? 


White point and gamma need to be more clearly documented for other options 


29 SINVIDIA. 


ISSUES 


Frame-based Color Space Transitions 


Applications can change _DEEPCOLOR_COLORSPACE at any time 
When does this correspond to a change in rendering? 
“Frames” are poorly defined in X without the Present extension 


Hand off atomic updating of _DEEPCOLOR_COLORSPACE to Present extension? 
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ISSUES 


EGL and Vulkan Extensions 


EGL_EXT_gl_colorspace_* 
VK_EXT_swapchain_colorspace 


GLX 


Definitions of color spaces and encodings need to align 
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